Why temperature chaos in spin glasses is hard to observe 
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The overlap length of a three-dimensional Ising spin glass on a cubic lattice with Gaussian inter- 
actions has been estimated numerically by transfer matrix methods and within a Migdal-Kadanoff 
renormalization group scheme. We find that the overlap length is large, explaining why it has been 
difficult to observe spin glass chaos in numerical simulations and experiment. 



Chaos, rejuvenation, memory, and aging in spin glasses 
are currently being intensively studied |[ ||, |], [|, 
li @i Hi Hi- "Chaos" refers to the property that equi- 
librium states in the ordered phase of spin glasses are 
sensitive to arbitrarily small changes in the couplings 
or in temperature, and is one possible explanation for 
memory effects in spin glasses , although other mech- 
anisms are also present pj. There is evidence both for 
and against temperature chaos in computer simulations: 
some authors claim to see the effects of chaos (?]], oth- 
ers have failed to see it P, 01. fn this Letter we start 



from the droplet 11 or scaling |T2| pictures and calcu- 
late numerically the overlap length L*(T, AT), i.e. the 
length scale beyond which spins at temperatures T and 
T+ AT become uncorrelated with each other, for a three- 
dimensional Edwards- Anderson Ising spin glass and also 
within a Migdal-Kadanoff renormalization group scheme 
(MKRG), both with a Gaussian distribution of couplings 
with unit variance. We show that this length scale is 
large within much of the parameter space, and only just 
comes down to magnitudes accessible to numerical simu- 
lations for certain values of T and AT. We believe that 
this is why some workers have been unable to see chaos 
in their investigations. As a by-product, we will also 
find the root mean square droplet interface free energy 
F(T) ee V(FL(T))_ and entropy S(T) = ^/(Sf nt (T)). 
The angle brackets indicate averaging over realizations 
of the bond couplings. We show that S(T) ~ y/T for 
small T, contrary to previous arguments |l3|| . 

In the MKRG scheme for three dimensions, renormal- 
ized bonds after n renormalization steps are ob- 

tained from the set of bonds { J^™ -1 )} after n — 1 renor- 
malization steps using the relation 
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where J\\i are randomly drawn members of the bond 
pool ( "pool method" ) . For a detailed description of the 
method in the present context we refer the reader to [|l4| . 
The renormalized bonds play the role of the interface free 
energy of a system of linear size L — 2™, to wit ^F(T) = 
(( J^")) 2 ) 1 / 2 , the angle brackets indicating the average 
over the bond pool. Similarly, the interface entropy is 
given by ±S(T) = lim a ^ ((J (n) - J' (n) ) 2 ) 1/2 1 5T , where 
J'^ is the corresponding member of a bond pool which 



has been evolved at temperature T + ST. 

The MKRG applied to chaos in spin glasses has the 
advantages that large length scales are easily accessible 
numerically and that it is possible to access and estimate 
the overlap length directly. Banavar and Bray have 
shown that the overlap length L* is related to the ratio of 
the interface entropy and interface free energy. Introduc- 
ing the usual generalized stiffness coefficients Y(T) and 
cr(T) via 



F(T) = T(T)L e and S(T) = a{T)L 



d B /2 
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(valid for large system sizes L), a measure of the overlap 
length for a temperature step AT <C T is obtained by 
equating F(T) and S(T) AT: 
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Here, C = 2 — ^ * s * ne cnaos exponent, where d s is the 
fractal dimension of the droplet interface and 9 is the 
droplet excitation energy exponent. 

Independently, the overlap length can be obtained as 
the length scale on which two initially identical bond 
pools {</} and {J'}, evolved at two different tempera- 
tures, decorrelate. A measure for this is L* = 2 no where 
no is such that 



((J(™°)) 2 ) + ((J' (no) ) 2 ) ~ 2 



(4) 



This method does not require a small temperature dif- 
ference. When the temperature difference does happen 
to be small, however, it agrees with the previous method 
up to a numerical factor close to unity (see below). 

Repeating the numerical work from |1J] with greater 
accuracy (pool size 2000000 and 'long double' precision) 
and for a larger set of temperatures, we find T(T) and 
cr(T) as shown in Fig. |l|. The data for <j(T) in this fig- 
ure has been obtained using a fixed relative temperature 
change e = ST/T = 10~ 6 at each temperature. 

Huse and Fisher |r| argued that a droplet interface 
can be regarded as a collection of roughly independent 
two level systems, each of which has on average an 
entropy proportional to T, which should give rise to 
S(T) ~ T. This is clearly violated by the data in Fig. 0. 
We will come back to this point later. 
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FIG. 1: Data for T(T) (solid line) and cr(T) (dashed line) 
from Migdal-Kadanoff renormalization. The dotted line has 
slope 1/2 for comparison. 




FIG. 2: Plot of the overlap length L* as determined from the 
MKRG data and Eq. (|) with < = 0.7448 for AT = 0.01 (solid 
line) and AT = 0.1 (dashed line). The dotted line shows a 
direct determination of L* for fixed absolute temperature shift 
AT = 0.01, (see text). 



The overlap length L* as obtained from the data 
for T and a using Eq. (||) is shown in Fig. ^. This 
requires knowing £. For the d-dimensional Migdal- 
Kadanoff scheme, d s = d — 1 (i.e. d s = 2 in the present 
case), and 9 was estimated from the numerics to be 
9 = 0.25519 ± 0.00005 for d = 3, therefore < w 0.7448. 
For illustration, the temperature shift has been arbitrar- 
ily set to AT = 0.01 and AT = 0.1 for this plot. Since for 
these values of the parameters the temperature shift AT 
is not much smaller than T for small T, Eq. || is not ex- 
pected to hold and the "true" overlap length differs from 
the data shown. A direct determination of the overlap 
length (as the decorrelation length of the two bond pools 
as explained above) with AT = 0.01 is shown in Fig. ||for 
comparison. A small constant has been added to the lat- 
ter curve to make the two ways of determining L* agree at 
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FIG. 3: The overlap length L* as a function of two tempera- 
tures Ti and T%. The contour lines are situated at L* = 10™^ 5 , 
beginning with n = 8 (i.e. L* m 40 lattice spacings) and 
counting from the upper left and lower right hand corners to- 
wards the middle diagonal, where L* diverges. The highest 
contour line shown is at n = 22 where L* m 25000. 



the minimum. (This adjustment reflects the arbitrariness 
of the constant 1/2 in the definition, through Eq. (Q), of 
L* .) With this correction, the two curves for AT = 0.01 
agree very well in a region around the minimum; they dif- 
fer for small T since AT > T and for T close to the criti- 
cal temperature because of increasing influence of critical 
point controlled decorrelation p5[ . 

Fig. H shows a contour plot of the overlap length in 
the two-temperature plane, obtained from MKRG in the 
same manner as before. This figure shows that the over- 
lap length is nowhere less than 40 for T\ , Tb < T c = 
0.89645 .... Note that in agreement with jL5| the over- 
lap length is nonzero even above T c . 

Obviously, L* is extraordinarily large for most values 
of T and never comes into a numerically accessible range, 
which, by today's standards, would be around L* as 20. 

While the Migdal-Kadanoff renormalization method 
allows study of large length scales, it has drawbacks: the 
fractal dimension of a domain wall d s on a cubic lattice is 
not well approximated, so the structure of an interface is 
significantly different on a hierarchical Berker lattice |ll| 
(for which MKRG is exact) than on a cubic lattice. It is 
therefore not obvious that the overlap length as obtained 
above is characteristic of a three-dimensional Edwards- 
Anderson spin glass as well. In order to test this, we used 
the transfer matrix method as described in jl7| to nu- 
merically obtain the interface free energy and entropy of 
small spin glass samples. This method has the disadvan- 
tage that due to demands on computer time and mem- 
ory, only samples of size up to L = 4 are accessible with 
reasonable statistics. On the positive side, there are no 
approximations involved whatsoever. This approach is 
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FIG. 4: Scaling plot for the interface free energy (top) and 
entropy (bottom). The numbers of samples used were 2 • 10 
(L = 2), 1 • 10 5 (L = 3), and 2 ■ 10 4 (L = 4). With = 0.181 
and d a /2 — 1.192 good data collapse is achieved. 



therefore complimentary to the Migdal-Kadanoff scheme. 
We shall use Eq. (||), which applies generally wherever 
the droplet picture holds, to provide estimates of L* from 
measurements of T and <r. 

In order to obtain the interface free energy Fi nt of a 
spin glass sample of size L x L x [L + 1) at tempera- 
ture T, first the free energy of the sample with periodic 
boundary conditions along the first two dimensions and 
fixed boundary conditions (+1 on both sides) along the 
third dimension is calculated. Next, the free energy of 
the same sample with boundary condition +1 on the one 
side and —1 on the other is calculated. The difference 
is the interface free energy. The interface entropy S- ln t is 
obtained by repeating the above for temperature T + 5T 
and taking the numerical derivative of -Pint- From these 
data, the root mean square averages F(T) and S(T) are 
calculated. 

The data for the interface free energy and entropy 
are shown in Fig. ^ as scaling plots for system sizes 
L ~ 2,3, 4. The entropy has been obtained with a fixed 
relative temperature shift e = 5T/T = 10~ 4 . The plot 
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FIG. 5: Estimate of the interface area from a bond perturba- 
tion calculation. The + symbols are for d = 3, and the dashed 
straight line is a best fit with slope d 3 — 2.697 ± 0.002. The 
numbers of samples used are as in Fig. ^ and 100 for L — 5. 
The crosses are for d = 2 and the dotted straight line is a 
fit with d s = 1.3 (the line is to guide the eye only; better 
data can be found in |12[ ). The squares represent the av- 
erage of S 2 (T)/T in d = 2 over a temperature range where 
this quantity is approximately constant, multiplied by an ar- 
bitrary number in order to make it comparable to the other 
data. 

for F(T) allows for an estimate of 9, the one for S(T) 
for an estimate of d s (cf. Eq. (0)). The values obtained 
are 9 w 0.18 and d s » 2.38, leading to ( » 1.01. While 
these numbers are merely crude estimates (corrections to 
scaling are expected to be significant for these small sys- 
tem sizes) and therefore no error bars have been supplied, 
they certainly lie in the expected range and the value of 
d s , in particular, shows that the droplet interface struc- 
ture is much better captured even for these small systems 
than in the MKRG. The scaling in Fig. || naturally breaks 
down close to the critical temperature, due to the small 
system sizes. 

The fractal dimension d s can also be estimated at zero 
temperature from a bond perturbation calculation as in 
p"2[ . The result, shown in Fig. ||, is d s w 2.7, obtained 
from sample sizes L = 2,3, 4, 5. The discrepancy between 
this result and the one above illustrates the influence of 
finite size effects. A similar comparison in two dimen- 
sions also shown in Fig. ||, gives the same kind of 
discrepancy for small L, which however is removed when 
going to larger L. It is found that the value obtained from 
bond perturbation is more reliable than the one obtained 
from a scaling plot of the entropy; the bond perturbation 
data lie almost perfectly on a straight line even down to 
L = 2. In three dimensions, the same seems to be true 
since d s m 2.7 compares well with d s « 2.68 from p8[ . 

The interface entropy in Fig. [l] again scales as S(T) ~ 
VT, showing that this behavior is not special to the 
MKRG. In order to understand this, we return to the 
two- level-system argument of El . The interface entropy 
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is calculated from the change in entropy after a change 
of boundary conditions, therefore it is necessary to know 
the excitation energy of each two level system under both 
boundary conditions. That these will in general be dif- 
ferent becomes apparent when considering, e.g., a single 
spin on the interface: since it is on the interface, at least 
one but not all of its neighboring spins change sign when 
changing boundary conditions, thus giving rise to a dif- 
ferent effective field for the spin, i.e. a different excitation 
energy for flipping this spin. Therefore, the interface 
entropy contribution from a two-level system is in fact 
AS(A+ A-) = S 2 _ lcv (A+) - S 2 _ lcv (A-), where A± are 
the excitation energies under the two boundary condi- 
tions. It is easy to check that the entropy of a two- level 
system is 

/ A \ A A 

S 2 _i cv (A) = log f 2 cosh — J - — tanh — . (5) 

The function 5 , 2_i ev (A) has a maximum at A = and 
decays to zero on scale T, therefore AS(A + , A - ) is non- 
zero essentially only in two perpendicular strips of width 
T along the A 1 * 1 axes, excluding their overlap region 
around the origin. Thus only those two-level systems 
contribute to the interface entropy which have excitation 
energies A + < T and A~ > T (or vice versa). This 
implies that the second moment, taken with the joint 
probability distribution p(A + , A - ), goes as 
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provided the marginal distribution dA + p(A + , A - ) is 
nonzero for A~ = 0. This result is very well supported 
by the data in Figs. [l] and [|. 

The overlap length as estimated from F(T), S(T), and 
Eq. (J|) is shown in Fig. |[ While being smaller than for 
the MKRG, L* is still very large (L* > 30 for AT < 0.1) 
and thus (just) out of range of numerical simulations. 
In fact with the parameters as used in (Ti = 0.7, 
T 2 = 0.4), the overlap length is estimated to be L* w 20, 
while the authors are using a system of size L = 24. This 
is in accord with the authors' claim that they have been 
able to observe the effects of temperature chaos. Again, 
we would expect modifications to the small temperature 
behavior of L* if a fixed absolute temperature shift is 
used (cf. Fig. |2|), but not in the region of the minimum. 

Finally it is worth remarking that the large value of the 
overlap length will have implications also for experiments 
on memory and rejuvenation. The effects of chaos are 
only visible when the length scale L(t) within which the 
spins are well-equilibrated after waiting for a time t, is 
larger than the overlap length L*. As Lit) only increases 
very slowly with time, many experiments will not satisfy 
the criterion L{t) > L* and it will then be inappropriate 
to use chaos ideas to explain what is happening. 
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FIG. 6: Overlap length as calculated from the transfer matrix 
method. Top curves are for AT = 0.01, bottom curves for 
AT = 0.1. For this plot, £ = 1.01 has been used as obtained 
from Fig. ^. There is no qualitative difference, however, if a 
more realistic £ = 1.15 is used. 
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